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Abstract 

The Kolmogorov-Sinai (K-S) entropy is a central measure of complexity and chaos. Its calculation 
for many-body systems is an interesting and important challenge. In this paper, the evaluation is 
formulated by considering ^-dimensional symplectic maps and deriving a transfer matrix formalism 
for the stability problem. This approach makes explicit a duality relation that is exactly analogous 
to one found in a generalized Anderson tight-binding model, and leads to a formally exact expression 
for the finite-time K-S entropy. Within this formalism there is a hierarchy of approximations, the 
final one being a diagonal approximation that only makes use of instantaneous Hessians of the 
potential to find the K-S entropy. By way of a non-trivial illustration, the K-S entropy of N 
identically coupled kicked rotors (standard maps) is investigated. The validity of the various 
approximations with kicking strength, particle number, and time are elucidated. An analytic 
formula for the K-S entropy within the diagonal approximation is derived and its range of validity 
is also explored. 

PACS numbers: 5.45.Jn,5.45.Ra,5.45.Pq,2.70.Hm 
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I. INTRODUCTION 



The Kolmogorv- Sinai (K-S) entropy is a widely used measure of chaos in dynamical 
systems and indicates the exponential rate at which information is produced due to 

the complex dynamics. It is also the exponential rate at which certain iV-dimensional phase 
space differential surfaces expand, where N is the number of degrees of freedom. It is positive 



S,i 



only for chaotic systems and vanishes otherwise. According to Pesin's theorem [31, in a closed 
fully chaotic system it is also the sum of all positive Lyapunov exponents, which measure the 
local exponential divergence of phase-space trajectories. In an open or scattering system, the 
difference between the sum of the positive Lyapunov exponents and the K-S entropy may be 
related to transport properties like diffusion coefficients [4], thus providing a link between 
the macroscopic and microscopic dynamics. Given its central importance, it has not only 
been calculated in low-dimensional and model systems, but also in many-body systems such 
as dilute hard sphere/disk gases js-7] and dilute wet granular gases {sj. It transplants the 
notion of entropy, originally introduced as a measure of disorder in statistical mechanics, 
into the context of low-dimensional deterministic dynamical systems. 

The finite-time K-S entropy turns out to be the natural measure that appears in semiclas- 
sical mechanics and provides, along with the principle of uniformity of periodic orbits and 
periodic-orbit information (i.e. actions, periods, and Maslov indices), the route to inferring 



quantum spectra from classical dynamics via the Gutzwiller trace formula (9). It appears to 
have important connections to the rate of entropy or entanglement production in stro ngly 
chaotic, but weakly coupled systems, the rate being proportional to the K-S entropy [101 ]. 
Finite-time Lyapunov exponents have also proven useful in many contexts and were recently 
used for instance as indicators of the presence of very small regular islands in an otherwise 



chaotic phase space 
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Lis)]. In high-dimensional systems, it seems more natural to study 
a finite-time K-S entropy and look at the fluctuations of this quantity in an ensemble of 
trajectories as a potential measure that can indicate non-ergodicity. 

This paper addresses the issue of calculating the K-S entropy from these motivations and 
restricts attention to Hamiltonian systems in the form of symplectic maps [l|. In particular, 
the connection to a transfer-matrix formulation is made explicit, wherein a (transformed) 
Jacobian plays this role, and the problem is formulated in terms of the spectra of block tridi- 
agonal Hermitian matrices. A general duality relation emerges that has an exact mapping 



to previous work on Anderson models of transport , ll5| . A generalization of the Thouless 
relation gives an exact formula for the finite time K-S entropy in terms of an average over a 
phase at the boundary. Although the connections between Lyapunov exponents of transfer 
matrices and localization length through transfer matrices have been well known for quite 



some time 



3, 



to our knowledge the generalization to the K-S entropy of classical sym- 



plectic maps is absent. Nevertheless, the ingredients from the localization and generalized 



transfer matrix literature are indeed there 



In this paper the focus is on the the infinite time limit (asymptotic) entropy. The for- 
malism is used to derive a simply calculable upper bound for the K-S entropy that becomes 
better the stronger the chaos as well as with the number of particles in the system. Further- 
more, it is possible to argue for a series of increasingly restrictive approximations culminating 
in the "diagonal approximation" of the K-S entropy that gives estimates often much better 
than the upper bound in regimes of fully developed chaos. The diagonal approximation was 
discussed in some detail recently in the context of two-dimensional maps via the standard 



map 



A generalization to higher dimensions is provided herein. The treatment, though 
restricted to symplectic maps or Poincare sections of Hamiltonian flows, can conceivably be 
usefully extended to continuous flows. 

Both the diagonal approximation and the upper-bound are defined in terms of spectra of 
instantaneous Hessians of a potential (through the Hessian of the action). Studying stability 
problems using the Hessians of potentials to calculate quantities of a similar nature as the 
K-S entropy is not new. They appear naturally in stability problems as part of a curvature. 
For instance, they appear in using Riemannian geometry to study stability, in particular 
to find the largest Lyapunov exponent Also, a Hamilton- Jacobi formulation of the 

K-S entropy 18] uses similar quantities. The approach presented in this paper, though, is 
different as it is based on generating functions and generalized transfer matrices. It provides 
routes for several approximations and bounds in both the chaotic and moderately chaotic 
regimes. 

The diagonal approximation is applied to the K-S entropy of a system of N strongly 
interacting kicked rotors, which may be considered to be a kicked version of the well-studied 



Hamiltonian mean field model 



19] , and which has also been studied for sometime 20( . That 



interest continues, for example, Ref. 2l| is related to the present work. They calculate the 



K-S entropy numerically, among other results. An analytical expression for the K-S entropy 



is derived in this paper by finding the density of states of the potential Hessian. This is 
perhaps the first analytical evaluation of the K-S entropy in a nontrivial model of a many- 
body chaotic system of this kind, whereas for the two-dimensional standard map (kicked 
rotor) the Chirikov estimate of the Lyapunov exponent or the K-S entropy has long been 



known 



22|. 



II. FROM TRANSFER MATRICES TO THE K-S ENTROPY 

Consider an iV-degree-of- freedom system with the phase space coordinates (q, p). The 
discrete time evolution indicated by the subscripts is derived from a generating function 
F(q, q') of old (q) and new (q') coordinates, 

p = -V q F(q,q'), p' = V q ,F(q,q') . (1) 

This follows from the stationarity of the action W(q ,...,q t ) = ^*~q ^(q^, q^+i) at the 
interior points (1 < % < t) of trajectories of length t + 1. The action derivatives at the 
edges of the trajectory are non-zero, giving the momenta at these points. The analogy 
with transfer matrices becomes more complete ahead with the introduction of the auxilliary 
generating function 

F(q,q') = F(q,q')-£|q|72 (2) 

where E is a real number. This is equivalent to adding an isotropic harmonic oscillator of 
frequency to the potential, whose frequency set to zero recovers the original dynamics. 
Denoting the discrete time as subscripts, the Jacobian Jj matrix propagates phase space 
variations, or is the tangent map: 

(3) 




(4) 



(5) 



The following relation then holds 



Tj — L i+1 JjL^ 1 , Jj — L^TjLj. (6) 



Defining the matrices Q and Mj_i as 



gives 



where 



l^ijfci — -^7 — r— ^7 — s— , {^h-i)kl — — tt, — r^T r- {< 



5pi = Q5qi - Mi_i5qi_i , (8) 




(9) 

Note that while Q is a symmetric matrix, Mj may be, but generally is not. In the following, 
it is assumed that Mj is a positive semidefinite matrix, which implies that the symplectic 
map generated by it is a twist map. The Jacobian and transfer matrices can be written in 
terms of the matrices introduced above with the addition of C defined as 

~ _ <9 2 F(q t , q m ) 
{^i)kl - -s? — T~^7 — \~ ■ l iU J 

Denoting the dependence on the real parameter E as Si(E) the Jacobian is 

Ji(£ )=| -W-KE-t.) (Ml)' 1 

\ -C l+1 (Mf)-HE - C,) - M, C i+1 (Mf)-' 1 

and the transfer matrix is 

Tj(B) /(-MD-^-Q-c,)^)-^ ( (i2) 

The Jacobian and transfer matrices over a time t are the products J(E) = J t (£')J t _ 1 (£') • • • Ji(-E') 
and T(E') = T t (_E) • • • T 1 (£'), respectively. By construction, j(E) is a symplectic matrix, 
but the transfer matrix generally is not. To relate the spectral properties of J(-E'), which is 
of interest, to those of transfer matrices, a closely related matrix 

t(E) = Ul^TiE) (13) 



is introduced. This matrix must be isospectral with J(-E) since the pair are related by a 
similarity transformation, 1(E) = L^ 1 T(E)Li. It follows also that T(E) is symplectic, 



f T (£)ET (£) = E, £ 



M 
-MS" 



(14) 



Therefore the characteristic polynomial of J(-E'), P(X) = det[J(£') — XI] is identical to that 
of T(E), and is reflexive, i.e. P(X) = X 2N P(1/X). Note that in the cases of the central orbit 
being periodic of period t or the U independent of time, T(E) coincides with the transfer 
matrix T(E). The latter is the case for many multi-dimensional symplectic maps considered 
in the literature so far. 

The advantage of the transfer matrix approach, rather than working directly with the 
quantity of interest, i.e. the Jacobian, is that it immediately motivates the construction of 
a "Hamiltonian" , not to be confused with the one which may be generating the dynam- 
ics. Before constructing this fictitious Hamiltonian, the "boundary" conditions need to be 
ascertained. Let (5qi,<5q ) T be an eigenvector of T(E) with eigenvalue A, then 



LiL t - + \ 





(15) 



which implies that 



Sq t+ i = A5qi 



(16) 



Again, if the orbit was periodic with period t or if Lj was independent of time, the conditions 
would be simpler. Using the transfer matrix, a vector of dimension Nt can be built out of 
the initial variation that is an eigenvector of T(E): tpx^ = (<5qi, • • • , $<lt) T - Using the above 
boundary conditions it follows that iVt-dimensional vector satisfies the eigenvalue equation 



H(X)^ E = Elp\,E 
where %{X) is the Nt dimensional matrix: 





(17) 



^C 1 + C m -Mf 



-Mi 




-XUJ 



Co + c, 



Ml 







-M 2 C3 + C3 -Ml 








-M t _i Q + Q J 



(18) 
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Thus there is a duality in the sense that if and only if T(E) has an eigenvalue A, has 
the eigenvalue E. The "Hamiltonian" above is the Hessian of the action when A = 1. 

The matrix T-L(X) is Hermitian in the case A lies on the unit circle. It is a block-tridiagonal 
matrix with corner blocks. When N — 1, such a formulation for periodic orbits has been 
known for some time and used by Bountis, Helleman j^J and Greene {24) to study stability 



of orbits in the Chirikov- Taylor standard map. For iV > 1 an extension was discussed, again 
for periodic orbits, by Kook and Meiss [25|. In all these cases, E = was the relevant 
parameter. The extension here is valid for arbitrary orbits and includes a parameter that 



makes the analogy with the literature on generalized tight-binding models direct. In this 
context, the works of Molinari [14|, H5[ discuss the extension beyond one-dimension and 
applications include multichannel scattering in mesoscopic systems. There, E is the energy 
and the eigenvalues of the transfer matrix relate to localization. The relation of Eq. ( TT8|) 
follows by considering how variations evolve under a Newtonian formulation of dynamics in 
terms of second difference operators, however the above method explicates the structure of 
the transfer matrix, and its relationship to the Jacobian. Classical mechanics is naturally 
equipped with these structures. 

There is a simple relationship between the characteristic polynomial of "H(A) and -P(A), 
the characteristic polynomial of -1(E) and T(E). This is essentially the "duality" relation 
that was discussed in the context of transfer matrices by Molinari and is a generalization 



of that stated by Kook and Meiss for periodic orbits [25|]. The simultaneous vanishing of 
the polynomials implies their proportionality: -P(A) ~ det[H(X) — E]. -P(A) is a polynomial 
in A of order 2N, with the leading term being A 2JV , and det["H(A) — E] runs from X N to 
X~ N . Thus the coefficient of X N in det[H(X) — E] provides the proportionality constant. 
Using the basic definition of the determinant as a signed sum of products of matrix elements 
whose row and column indices are permutations, it is possible to conclude that this is 



1) det(Mi • • • M t ) 26| . This gives the duality relation stated in terms of the original 



Jacobian matrix polynomial as: 

P(A) = det(J(£) - XI) = {-X) N det(M a • • ■ M t ) _1 det[H{X) - EI}. (19) 

It is consistent with the relations mentioned for periodic orbits in {25 1 as well as in the work 
on transfer matrices. 

There are several consequences of this duality relation that can be derived, and are 



potentially useful in estimating entropies of dynamical systems. First consider the case 
E — 0, which corresponds to the generating function of interest. Let the set of eigenvalues 
of J = J(0) be {expit^k + H(pk)} ■ From the reflexive property it follows that the reciprocal is 
also an eigenvalue and from the reality of the polynomial (even if E ^ it is always assumed 
real here) that the complex conjugate is also an eigenvalue. Thus the eigenvalues either come 
in pairs, in the case 7^ or <pk is zero, or in quartets. If the orbits are periodic, these different 
cases correspond to elliptic, hyperbolic and loxodromic orbits respectively. The numbers 
{7^} are important and indicate the exponential instability, they are finite-time stability 
exponents and are closely allied to the well-studied finite-time Lyapunov exponents. In the 
infinite time limit for generic systems they comprise the complete spectrum of Lyapunov 
exponents. The sum of the finite-time positive elements may therefore be considered more 
or less a finite-time K-S entropy {h t ). 

An exact formula for this finite-time K-S entropy h t follows by applying Jensen's for- 
mula {2?! to the analytic function -P(A), where A is now considered as a complex variable. 
Jensen's formula is a generalization of the Mean Value Principle of harmonic functions, and 
although log[|P(A)|] is not a harmonic function on the unit circle centered at the origin 
due to the zeros of -P(A) in the interior, these zeros can be removed in a suitably redefined 
function. That results in: 



From this exact relation for h t comes the first level of approximation. Under some circum- 
stances, such as long times and/or chaos that is not too weak, the ^-dependence of h t (8) 
becomes negligible. Without going into details just yet (to be discussed ahead), for the 
many-body kicked rotors there are very interesting, but not fully understood, regimes of 
behavior which emerge on this point. In particular and unexpectedly, for some initial condi- 
tions, values of interaction strength, times, and to the accuracy of the numerical calculations 
done, 



where h t (0) indicates that the time transient contribution due to a center of mass coordinate 
is first subtracted from h t (0). In those cases, h t = h t (0) effectively is not an approximation 





(20) 




(21) 



S 



and it is possible to study finite-time K-S entropy fluctuations via the simpler quantity ht(0] 



It could be useful for finding non-ergodic dynamics following the methods of Refs. llNl3|. 
but is outside the scope of this paper. 

In the limit of large times, h t reaches its asymptotic value, which is the K-S entropy 

h KS = lim -ln|det(J - I)\ = lim -- V ln[det(Mi)] + - ln(| det[H(l)]|) (22) 

t^oo t t->oo t — ' t 

i=l 

(9 averaging no longer needed). The quantity defined herein, | det(J — I)\, appears in many 



considerations of a semic 
considerable interest 28, 



assical kind and the study of its behaviors and fluctuations are of 



29J. If the normalized density of eigenvalues of *H(1) is denoted as 



Ph(^), the entropy can be written as 

h KS = - (ln(det(M,))) + N j ln(|//|)p H (/i) dp,. (23) 

Although the spectral problem seems to have been compounded by now focussing atten- 
tion on a iVt-dimensional matrix (t — > oo) instead of products of 2N dimensional ones, in 
fact the eigenvalues of the large matrix are usually bounded, whereas those of the product 
exponentially increase. 

A second level of approximation suggests itself here and is denoted the banded approxi- 
mation. As the spectrum depends little on the nature of the corner blocks, they may as well 
be neglected entirely. In that case, % is truly banded and its determinant and spectrum can 
replace that of "H(l) in Eqs. ( 12211231) . This approximation can be extremely useful numerically 
as the diagonalization can be performed much more efficiently Very little is lost in making 
this approximation and it is expected to be valid even well into the weakly chaotic regime. 
It may yet be possible to study finite-time fluctuations at this level of approximation. 



III. AN UPPER BOUND, THE DIAGONAL APPROXIMATION, AND AN ES- 
TIMATE 

The following considerations are for a specialized class of generating functions, mechanical- 
type, that are still general enough to contain many of the Hamiltonians studied in the 
literature on coupled maps. The idea is to focus on the essential details and facilitate 
interpretation, as the generalizations are straightforward. Let 

F(cLi, q m ) = i(cu - q i+ i) • M • (q* - q i+ i) - V(q) (24) 
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where M is a constant symmetric positive semidefinite matrix. Then the symplectic map is 

q*+i = + M- 1 p 4 +i (25) 
p i+ i = Pi- W(q*). (26) 

In this case the U matrices are independent of time i, and the instantaneous transfer matrix 
Tj is a similarity transform of the Jacobian matrix Jj. The "Hamiltonian" is 

( -V{ + 2M -M ■••0 — M \ 

-M -V/ + 2M -M ■•• 
-M -V" + 2M -M ••• 



H(l) 



(27) 



\ -M ■ • • -M + 2M / 

where V" is the instantaneous Hessian matrix of the potential. Thus in this case the first 
block of the matrix remains as if the orbit were periodic. 

The matrix "H(l) although Hermitian is not positive semidefinite. Consider the diagonal 
N x N blocks of the positive definite matrix U{lf. These are 2M 2 + (2M - V") 2 , which 
are themselves clearly positive semidefinite. A generalization of the well-known Hadamard 
determinant inequality may be applied. If A is a positive semidefinite matrix whose diago- 
nals are partitioned into t, N— dimensional square matrices Pj that are themselves positive 
semidefinite, then det(A) < II* =1 det(Pj). In the instance that N — 1 and the Pj are simply 
the diagonal elements of A, this is the usual Hadamard inequality. The inequality general- 
ization provides a better upper bound and may be compared with other generalizations of 



the inequality such as Fischer's 



30] . Applying this inequality with A = "H(l) 2 results in an 



upper-bound S for the K-S entropy 



1 * 

h K a < h KS = hm ±^ In (det [21 + (21 - r^M" 1 ^) 



-In (det [2/ + (2/-M- 1 / 2 V"M- 1 / 2 ) 2 ])^ = ^ J ln(2 + /i 2 )py(/i) dp 

(28) 

where M -1 / 2 is the unique positive semidefinite square-root of the matrix M. The product of 
the mass matrix with the potential Hessian is written such that the resulting matrix remains 
symmetric, however this is not necessary and the form M _1 V" maybe used instead. The an- 
gular brackets indicate replacing the time-average by a space-average, assuming ergodicity as 
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in the case of chaotic dynamics. The final equality is written in terms of py{y), the normal- 
ized density of eigenvalues of the N dimensional symmetric matrices 21— M _1//2 V"M -1 / 2 . An 
ensemble is formed out of the instantaneous potential Hessians to construct such a density. 
For many systems this is an easily calculable upper-bound depending on the Hessian of the 
potential. In terms of an interpretation, the local instantaneous Hessians provide an equiva- 
lent set of harmonic oscillators and the instability is bounded by this system. The larger the 
potential curvature is, the larger the upper-bound can be. Surprisingly, the upper-bound 
can almost be reached, and it gets better with increased chaos and/or particle number. 

As the upper-bound is dominated by the diagonal blocks with the Hessian of the poten- 
tial it may be expected in strongly chaotic cases that just the diagonal blocks provide an 
approximation to the whole matrix. This constitutes the "diagonal approximation" which 
can be written as the assertion that: 

h KS ^h d = lim - Vlnjdet (2/- M- 1/2 V^'M- 1/2 )| = N f In |/i|p v (//) dp. (29) 
i=l J 

In fact for the diagonal approximation to be valid it must turn out that p#(/i) ~ Pv{^)i 
thus ignoring the different ways the mass matrices enter the definitions. 

A detailed study of this approximation was made for the case of the Chirikov- Taylor 
standard map in Note that this is a "local" approximation in the sense that it is 

built out of adding contributions at each instant of time. The above derivation does not 
estimate errors and may be regarded at this stage as heuristic. However, recall that for the 
one-dimensional case it is possible to write an expansion of the determinant and estimate 
errors. In fact it is worth pointing out that for the one-dimensional standard map with 
V(q) = —{K/A-n 2 ) cos(27rg), the upper bound is given by 

h KS = ~ J In (2 + (2 - ircos(2vrg)) 2 ) dq = In ^ + -L + 0(^ 2 ), (30) 



which is close to the widely used estimate of Chirikov 22j that coincides with the diagonal 
approximation: 

f 1 \K\ 
h d = ln|2- J fsTcos(27rg)| dq = \n± — l - . (31) 
Jo 2 

A more detailed and careful analysis of this case gave 

h KS = \n l ^ + 1 ^- l + 0(K-«) (32) 
11 



thus showing that the diagonal approximation is closer to the "exact" entropy (in the one- 
dimensional case this is the same as the Lyapunov or stability exponent) than is the upper- 
bound. Nevertheless, both the approximation and the bound are indeed close to the actual 
value. 

Consider for a moment that under the action of completely chaotic dynamics, the entries 
into the inverse mass matrix product with the Hessian become something like random en- 
tries. The determinant in Eq. (j29p could be treated as a random variable with normalized 
probability density pv(p) and a variance a 2 . In that case 



where y = p/a and p(y) has only weak dependence on particle number or interaction 
strength (assuming the system is chaotic). Thus, the result is the logarithm of the width of 
the density plus a remaining integral that is nearly a constant. In the case of a Gaussian 
density for pv(p), the constant is —(7 + ln2)/2, where 7 is the Euler-Mascheroni constant. 
In the case of a lognormal density, the constant is unity. If the distribution is not exactly 
zero-centered in its mean, then corrections emerge ordered in powers of the ratio of the mean 
to standard deviation. For example, the positive-off-centered Gaussian density gives 



a formula that is used ahead with minor modifications. Two forms are given for the result 
of the integral. The first is the convergent series, whereas the second is the asymptotic 
series. The latter is far more useful due to slow convergence of the former if the width 
is much smaller than the mean. Finally note that some significant information is lost in 
making the diagonal approximation. There is little reason to expect it to work well enough 
numerically to study finite time approximations just by limiting the number of consecutive 
instantaneous Hessians (the analytical expression is already fully ergodically averaged and 
without fluctuation information) and it cannot be expected to hold in the weakly chaotic 
regime as well as the banded approximation. 




(33) 




(34) 




(asymptotic series) , 
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IV. K-S ENTROPY OF A COUPLED MAP LATTICE 



Consider N identical particles each of whose configuration space is a circle and interacting 
via two-body forces that depend only on the angular distance — qj\; in this section 
the notation is changed such that subscripts label particles rather than time. Assume the 
mass matrix is diagonal with unit elements. The potential can be represented as V = 
Yli<j v ( \li ~ Qj I) an d there is a center of mass degree of freedom that can be removed from 
the calculation for any number of particles. Conveniently, the two particle case reduces to 
the one particle case with a renormalized interaction strength and can be used as a check. 
Before removing the center of mass, the Hessian matrix has the property that sums of row 
or column elements vanishes. 

In order to work through a concrete system in detail, a system of coupled Chirikov 
type maps is introduced that has been studied for some time and has many interesting 
features 1 201 . It can also be considered as the kicked version of the well-studied Hamiltonian 

n 

mean field model [19|]. The Hamiltonian is 

i/ = E| + ^ 2 -^E cos27r ^-^ £*(*-*)> (35) 

i=l v i<j n=— oo 

and the resulting map connecting variables just before subsequent kicks is 

N 



Pi=Pi+ ~ -7= £ sin 2vr(gi - qj ) 

Z7TVA . , 

Si = Si + Pi ■ 



(36) 



The kicking strength has been renormalized with v N so that the final K-S entropy will be 
extensive. In much of the previous research with this model this normalization has been used 
primarily so that with the same kicking strength increasing number of particles produces 
the same order of change in momentum for each of the particles. This follows as the sum 
over the sines will be of the order of y/~N if the qi mimic a random distribution. There is an 
additional closely related system, for which it is also useful to make a few brief comments. 
It has N particles on a ring, but only the nearest neighbors (NN) interact via the above 
forces. For this NN model, the renormalization of the interaction strength by y/N is not 
helpful and omitted. All remarks on this system are clearly preceded by a reference to the 
NN model. 
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For K = the system is integrable since all the elements of the set {pi} are constants 
of the motion. For more than a few particles, as \K\ is changed away from zero even by 
small amounts it is found numerically that the system develops significant chaotic dynamics. 
Even for values of \K\ on the order of, but less than unity, it is already extremely difficult to 
detect any remnants of stable dynamics. For a given configuration of particles the Hessian 
is given by: 

K . 

( V ")n = ~-7= Yl C ° S 2?r (* ~ 

i¥4 (37) 

K 

( v )ij = -~j= cos 2^ - i ^ j. 

and the mass matrix is always the identity matrix. 

The first step is to check the validity of averaging over 9 in obtaining the finite time K-S 
entropy. It is straightforward to show for 9 = 0, i.e. %(1), that the center of mass coordinate 
generates a transient contribution to the finite time entropy of 2hxt/t and this term is 
subtracted from h t (0) for the purposes of this discussion. Figure [1] illustrates the behavior 
of h t (8) in two regimes, one for stronger chaos and longer times and its opposite. Remarkably, 
for each of the three initial conditions pictured in the upper panel, h t (0) equals the average of 
h t {9). The ^-dependence is essentially identical for each initial condition except for an overall 
displacement, and it is this displacement which contains all the information contained in the 
fluctuations of the finite-time K-S entropy. For these parameters, the fluctuations are a 
small fraction of the infinite-time K-S entropy. The lower panel shows the more complicated 
^-dependence found at shorter times and weaker chaos. In this case, h t (0) does not equate to 
the ^-average. Curiously, after checking several other initial conditions, it appears as though 
the difference h t (0) — h t only takes on a discrete set of values approximately. Overall, it is 
found that replacing h t by /if (0) is an excellent approximation for large times. 

These results beg the question as to how well the banded approximation compares to 
h t (0). Just as h t (0) has a center of mass transient term, so also has the banded matrix. 
However, it is straightforward to show that its value is not the same as for h t (0). Rather, 
it is ln(t + l)/t and likewise is subtracted for the comparisons discussed here. In Fig. [2J, 
the difference between the two approximations for hxs is plotted as a function of time for a 
reasonably strongly chaotic case. There is no detectable difference not due to a random-like 
statistical error. In fact, this statistical error is smaller than the finite-size fluctuations in h t , 
and it may therefore be possible to get good estimates of the finite-time fluctuations even 

14 




FIG. 1. The 9 dependence of ht(0). The upper panel shows ht(0) for three distinct initial conditions 
compared with the 9 = values shown as horizontal dashed lines; in each case, the known transient 
contribution 2ln t/t is subtracted from ht(0). All three /if(0) values here happen to match nearly 
exactly (at least 5 decimal place accuracy) the 9 average. The solid flat line is the average over 
initial conditions, thus giving some idea of the scale of the finite-time entropy fluctuations. In the 
lower panel, a less well converged case, i.e. smaller K and t, is shown. There is more structure as a 
function of 9 and the 9 = value is not equal in this case to the ^-average shown here as the solid 
line. Note that ht{9) has an exact reflection symmetry about it and it is not necessary to show the 
range (ir, 2ir). 
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FIG. 2. The difference with time in the K-S entropy estimate calculated using the full %(1) and 
its banded counterpart in which the corner blocks are neglected. The transient 2lnt/t of 
at time t and the transient ln(t + l)/t of the banded approximation were both subtracted before 
taking the difference between the two approximations. 

using the banded approximation, at least for strongly chaotic systems. Though not shown 
here, the case K = 1 had a very similar appearance except with a larger statistical error. 

It remains only to understand its density of states under the ergodic assumption that 
the qi are uniformly distributed in [0, 1) over time and uncorrelated with respect to each 
other. The density of states is not that of a full random symmetric matrix, namely the 
Wigner semicircle, as there are only N random numbers input in determining the N x N 
Hessian matrix elements. In addition, the diagonal elements are a sum of iV — 1 random 
contributions whereas the off-diagonal elements have just one. Thus the spectra must reflect 
somehow this diagonal dominance. 

From Eq. ( |33|) . in the diagonal approximation finding this system's K-S entropy requires 
only the normalized spectrum of the potential's instantaneous Hessian. In fact, the density 
of states has a very interesting and curious structure in which there are three exceptional 
eigenvalues, whereas the remaining eigenvalues form a Gaussian sea centered near zero. One 
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of the three exceptional eigenvalues is the exact eigenvalue corresponding to the center of 
mass and the uniform mode, and the remaining two exceptional eigenvalues are "outliers", 
which for large particle number are well separated from the Gaussian sea formed by the 
others. 

The outliers' origins may be seen by considering the matrix A, which results from the 
superposition of two one-dimensional projectors: 

A = a(z/ 1 |0 1 )(0 1 | + z/ 2 |0 2 )(0 2 |), (38) 

where (j\(f>i) = cos2nq j / ^/i^, (j|0 2 ) = sin 27rq j / y /i^ and v x = cos 2 27^, v 2 = J] i sin 2 27rg i 
ensure normalization. Then the element A^ is identical to the i,j element of the Hessian 
if the scaling factor a = K/yfN. Choosing this value of a, the diagonal elements of 
A are constant and equal to K/yfN. As A is the sum of two one-dimensional projectors, 
it has exactly two non-zero eigenvalues, say Ai and A 2 , which can be found from tr(A) and 
ti{A 2 ). The relations are: 



Ax + A 2 = tr(A) = N^K , A 2 + A 2 = tr(A 2 ) = *^V_+1) + ^ ^ C os47r(g, - q k ) (39) 



j,k=l 



whose solutions are 



KN 1 ' 2 K 
A12 — — - — ± 



2iW2 



iV 



s cos4tt(^ -q k ) . (40) 
\ j,k=i 



These eigenvalues move toward infinity with increasing particle number and are each always 
close in value to KN 1 ^ 2 /2. In fact, their ensemble averaged root mean square displacement 
from this value is lower order and given by K/2. Furthermore, it is possible to deduce a full 
probability density for these eigenvalues assuming the set {g«} behaves as uniformly random 
variables on the interval [0, 1), i.e. the ergodic expectation for a fully chaotic dynamics. One 
method is to calculate the moments, 



N 

K 2m m\ (41) 



^ cos47r(g i - q k 
Lj,fc=i 



N ^ oo 



which are the moments of an exponential probability density. Another method is to realize 
that the sum is actually the sum of squares of two simple sums for which a central limit 
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theorem applies to each and that leads to a xl probability density. Again, this is exponential 
and consistent with the moment method. Therefore, for t = X + — KNl/2 



8t / 4t 2 \ 



(42) 



Thus, the initial scaling of the parameter as K/yN leads to the two nonzero eigenvalues 
of A being of the order of Ky/~N /2, and their fluctuations to be of order K/2 and hence 
independent of N. 

The eigenvectors, and l^), require a little bit more algebra to find because the two 
projector states are not orthogonal, i.e. (0i|02) 7^ 0. However, it turns out that for a 9 given 
just ahead, they can be expressed as 



ow = 



01*2) = 



cos(27rgj 



N 



1/2 



si 

sin(27T(7j — 9) 



S x = ^cos 2 (27rg i -9) 



N 



(43) 



S 2 = ^sin 2 (27r ?j -0), 

3=1 



The determination of 9 follows from imposing the conditions (^l^i) = and (^/ 2 |^4|^ / i) = 0, 
which require that 

TV 

O = ^sin(47r^--20) . (44) 



N 



3=1 

Denoting 

N " 1 

s = ^ sin (47rgj) and t = ^ cos (47rgj) gives 9 = - tan -1 - . (45) 

Applying A to the eigenvectors generates a relation between the value of 9 and the eigenvalue 
difference, 



or 



29 = <\> - cos" 1 



N 



^2 cos4vr(g i - q k ) 
Lj,k=i 



±jV 1 /2(A 1 -A 2 ) 



/v 



^ cos[47rgj - 20] 



= COS 1 



Vs 2 + 1 2 



(46) 



(47) 



^(Vs 2 + t 2 ) 

Although the matrix A is not the instantaneous Hessian, 21 — V", that is needed for the 
KS entropy problem, much of its spectral structure described above survives. The critical 
distinctions between the two matrices are entirely related to the diagonal elements as the 
off-diagonal elements are connected exclusively by a sign change. Alternatively, one could 
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write that 21 — V" = 21 — A + B, where B is a diagonal matrix whose diagonal elements 
are given by 

N 

B tt = Y,A 3 . (48) 
3=1 

Relative to the spectrum of —V", the identity operator introduces a trivial shift by two of 
the entire spectrum and can be accounted for at the very end. The B matrix, on the other 
hand, is responsible for ensuring the exact center of mass eigenvalue (zero) and eigenvector 
(constant coefficients iV" 1 / 2 ). Note that the center of mass can have nothing to do with the 
KS entropy. However, unlike the two previous levels of approximation in which the transient 
was decreasing with increasing time, the center of mass eigenvalue here leads to a constant 
contribution independent of time. Its eigenvalue must be excluded from the spectrum of 
py(/i). B also introduces three more effects: i) the two projector states cease being exact 
eigenstates, ii) they have non-vanishing overlaps with the center of mass eigenvector, and 
iii) the remaining N — 3 formerly zero eigenvalues all take on non-zero values. 

Nevertheless, adding the diagonal elements is found neither to shift the two special levels 
significantly nor alter the width of their variation. An educated guess as to the approximate 
structure of the perturbed projector eigenstates would be that the overlap with the center 
of mass eigenstate should be subtracted, 9 slightly altered to maintain the orthogonality, 
and the normalization constants recalculated, i.e. 



ow = 



ow = 



si 



1/2 



1 N 

cos(2nqj — 9) — — ^ cos(27rgj — 9) 



N 



sin(27r^ - 9) - — ^ sin(27rgi - 9) 



(49) 



where, for example, 9 would satisfy the relation 



N 



N 



7^0 



(50) 



^2 sia(47rq^ - 29) = — ^ cos(27t<2j - 9) ^ sin(27rg; - 

3=1 3=1 i= l 

which would give a new rotation differing from the previous one by an 0(N~ l l 2 ) shift. As the 
center of mass eigenvalue is zero, removing its small eigenstate contribution to the previous 
projector eigenstates has little to no effect on the eigenvalues. A priori, one might have 
anticipated that the loss of the K/N~ l l 2 term from the diagonal might have moved these 
levels, but in fact that does not happen. 
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That leaves the N — 3 eigenvalues to be understood. They are related to the introduction 
of the diagonal elements, which are of higher order than the off-diagonal elements, and 
those elements are mostly accounted for by the projector states. It is reasonable to expect 
and it is found that the remaining eigenstates are rather localized in nature except for 
having to be orthogonal to the 3 special extended states. The diagonal elements behave like 
Gaussian random numbers from a central limit theorem, and one can anticipate that the 
N — 3 eigenvalues form a Gaussian spectral sea. Thus, to summarize the spectrum of V" 
has a center of mass zero eigenvector with a uniform mode, which must be removed from 
the spectrum for entropy calculations, two delocalized modes with large outlier eigenvalues 
of the order of K\fN /2, and the remainder of the spectrum's N — 3 eigenvalues are in a 
Gaussian sea. 

The Gaussian sea has only two parameters to be determined, its centroid and width. Its 
properties can be determined by the first and second moments of the instantaneous Hessian 
similarly as done in Eq. ( l39l) . except assuming ergodicity in the dynamics, which leads to 
ensemble averaging. Given that 

JV 

.Y 1 1 



tr (21 - V") = 2N + cos2vr( gj - q k ) (51) 



j,k=l 

and that the sum of the three special eigenvalues equals 6 — KN 1 / 2 (now fully accounting 
for the identity operator also), the mean location of the remaining N — 3 levels (//) is 

1 / K N \ KN l/2 

M = \ 2N+ N^^ cos 27r ^ - ?*) + KN 1 ' 2 -6) =2 + -jj—^. (52) 

By the same method, it is possible to also calculate the variance of py(/ i )- Consider 

(tr [(2/-V") 2 ]) =AN + K 2 (N -1), (53) 

and subtract the contribution to this quantity from the three special levels to get the contri- 
bution for the remaining N — 3 levels to the mean square operator trace. Dividing by iV — 3 
and subtracting the square of (//) gives the variance as 

„ K 2 K 2 N , . 

*=~w=w (54) 

Clearly, the separation of a Gaussian sea and 3 special eigenvalues does not make sense if 
iV < 7 as the variance becomes negative, which is impossible. For large N, the width of the 
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Gaussian sea approaches Kj a/2, which is the same order as the width of the distribution of 
the two outliers, and is again independent of iV due to the scaling of the kicking strength. 
The centroid of the Gaussian sea is slightly more complicated. For fixed K and increasing 
N, it approaches 2. On the other hand, for a fixed, sufficiently large N, as K increases 
(K >> iV 1 / 2 ), it approaches KN 1 ^ 2 /{N — 3). Nevertheless, in either case for reasonably 
large N, the Gaussian sea does not overlap with the distribution of the two outliers, which 
are further out. 

All the ingredients for an evaluation of the K-S entropy within the diagonal approxima- 
tion, Eq. (|2"$|) . are in place. The two outliers contribute: 



h° 



In 



2 - 



KN 1 ' 2 



+ In 



KN 1 ' 2 
2 +t 



In 



2 - 



KN 1 ' 2 



p(t)dt 
(55) 



where pit) is given by the density in Eq. (f42|) . This integral can be evaluated exactly, 



h° 

,L KS 



exp 



4 
K 



N 1 ' 2 



Ei 



4 
~K 



N l/2 



(56) 



where Ei(x) is the exponential integral. The contribution from the Gaussian sea follows 
from a slight modification of Eq. ( )34|) and the final expression for the K-S entropy is 

2k 



IRS 



h° K s+< 



(iV-3) 



(iV-3) 



lna-^-£r=i 



2fc(2fc-l)!! 



(57) 



2k 



(p) » a 



where a is the width given by Eq. ( 154"]) and (p) is the center of the Gaussian given in Eq. (|52l) . 
As in Eq. f )34|) . the upper form is the convergent series and the lower form is the asymptotic 
series. 

The comparison of the upper bound, numerical diagonal approximation, and analytical 
diagonal approximation versus the banded approximation, which is taken to be essentially 
exact, as a function of interaction strength is shown in Fig. [31 It is seen that the upper bound 
does indeed lie above the other curves, and also as K increases it gets closer and closer to 
the true K-S entropy. Nevertheless, it is nowhere as good as the diagonal approximation. 
The diagonal approximation is equally good as an analytical approximation or numerically 
evaluated approximation independent of the strength of the chaos, which is shown in the 
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FIG. 3. The diagonal approximation of hxs- In the upper panel, the upper bound (highest lying 
curve) and the analytical form for the diagonal approximation (dashed curve) are compared to the 
banded approximation using t = 100 and ten initial conditions. In the lower rectangular box, the 
difference between the numerical diagonal approximation and the analytical form is shown. 



lower panel of the figure. It has a pair of unusual double-well-like variations in its behavior 
for weakly chaotic systems (one of the double well-like variations is on too small a scale to 
show up clearly in the figure). In this regime (small K), it is unable to follow the true K-S 
entropy. The K-S entropy is seen to be an asymmetric function of interaction strength. The 
diagonal approximation does a bit better on the positive K side. It is impressive that the 
diagonal approximation works on an absolute scale. On an entropy per particle basis, it 
would have even greater accuracy. Overall, for moderate K and N the formula with all the 
details is necessary for the quality of the agreement with the K-S entropy shown. 

Note that it is well-known that the usual standard map (with one-degree of freedom) 
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has a symmetry with respect to K ■<->■ — K due to their phase spaces being shifts of each 
other by one-half along the position direction. For the fully interacting maps, this symmetry 
is broken. This is seen in the ^-dependence of the eigenvalues of the two special outlier 
states, which changes sign with the K sign change (although the shift by two from the 
identity matrix does not). Likewise, the off-centered density of the remaining N — 3 states 
changes sign as well. The NN model retains the symmetry exactly for even numbers of 
particles on the ring. This can be demonstrated by shifting every other particle by one- 
half. We have not identified a similar transformation for an odd number of particles, but 
confirmed numerically that the symmetry remains. 

The entropy per particle for large N and \K\ becomes [neglecting 0(K~ 4: ) and 0(iV _1 ) 



contributions] 

N M 2 2 + K* + KVN' { ' 

The leading term is the same as the one-degree-of-freedom kicked rotor noted in Eq. fl32|) . 

although the correspondence cannot be pushed to far because the meaning of K is somewhat 

renormalized by removing the center of mass. It is interesting to note that the leading term 

odd in the sign of K goes a long way to explaining the difference in values of Hks f° r positive 

and negative K. For example, from the last term in the above equation the difference of 

hxs at the edges of Fig. [3] (K = ±30) is expected to be 1.192, whereas it is actually 1.182. 

Figure H] shows the diagonal approximation with fixed interaction strength and varying 
the number of particles. For values of K ^ —15 or K > 5, the diagonal approximation works 
extremely well. In these K regimes, above some value of N, the diagonal approximation 
matches the banded approximation to within sample size fluctuations (ten initial conditions 
were used). In the upper panel, a K- value is shown where the approximation is working 
well. As N increases the diagonal approximation converges to the K-S entropy quickly with 
particle number. The lower panel shows a weaker chaos case where the approximation is 
struggling a bit. There the two curves slowly diverge. For —15 < K < 5, increasing N does 
not improve the estimate of the KS entropy in an absolute sense, although it would still 
improve on an entropy per particle basis. 

Finally, in Fig. |5] the eigenvalue densities are shown as histograms for the full (h t (0), 
banded, and diagonal approximations, and compared to the analytical expression for the 
instantaneous Hessians (diagonal approximation). Excellent agreement is seen throughout 
the spectrum, including the details of the two outliers in the negative tail. In the case of the 
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FIG. 4. The ^-dependence of the analytical diagonal approximation. The solid curves are the 
banded approximation using ten initial conditions. The dashed curves are the analytical diagonal 
approximation . 

NN model, the density of states does not have outliers, and is symmetric about zero. The 
absence of outliers follows from the lack of a rank-2 projector structure for the off-diagonal 
part of the Hessian matrix. The density of states in the bulk is also not normal, as the 
diagonal elements do not look like sums of many random variables. Thus, while the mean 
field model has more features like the outliers, analytical approaches to the density of states 
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FIG. 5. The full, banded, and diagonal eigenvalue densities compared to the analytical form of 
the diagonal approximation. The three histograms result from using 5 initial conditions. It is 
essentially impossible to see the difference between the full and banded results. Small differences 
can be seen with respect to the diagonal case. 

and hence, the K-S entropy was possible, in contrast to the NN model which needs other 
special methods not considered here. 

V. SUMMARY AND CONCLUSIONS 

This paper presents a formalism to calculate the K-S entropy of symplectic maps of ar- 
bitrary dimension. Constructing a transfer matrix, and using a duality relation, a formally 
exact expression for the finite-time K-S entropy is given as an average over a phase in the 
[logarithm of a] determinant of an effective Hamiltonian. The Hamiltonian has a tridiagonal 
block-banded structure with corner blocks which alone include the phase. A series of ap- 
proximations naturally follow in this scheme. First, the variation with the phase is neglected 
and the resultant K-S entropy is found to get better with longer time. Second, the corner 
blocks of the Hamiltonian are themselves neglected resulting in a banded approximation 
that is found to be a very good approximation that is useful numerically, works even with 
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weakly chaotic systems, and may still be valid for studying finite time fluctuations. The 
third level of approximation involves dropping of all off-diagonal blocks in the Hamiltonian 
and constitutes the diagonal approximation. This is expected to hold only in regimes of 
strong chaos. A fourth estimate also follows as an exact upper-bound to the finite-time 
K-S entropy. The last two, namely the diagonal approximation and the upper-bound can 
be found from the spectra of the instantaneous Hessians of the potential and are therefore 
extremely easy to evaluate numerically, vastly simpler and numerically faster than even the 
banded approximation. 

One of the long term motivations was to study fluctuations in the finite-time K-S en- 
tropy, and we believe that neglecting phase averaging, one can still study such fluctuations 
for moderately chaotic regimes. More investigation is needed to find out under what circum- 
stances phase averaging can be left undone. Curiously, many initial conditions, though not 
all, led to a zero angle value, h t (o), exactly equal to the phase average (exact here meaning 
to the accuracy of our calculations). It appeared that differences when they appeared took 
on only a discrete set of values. Furthermore, the banded approximation also appears form 
a useful and powerful tool to study fluctuations numerically in a dynamically interesting 
range of parameter values. The diagonal approximation seems highly unlikely to reflect 
these fluctuations faithfully, especially in regimes of weak to moderate chaos. 

A thorough study of a kicked version of the Hamiltonian Mean Field model, or coupled 
standard maps, has been undertaken wherein the above approximations have been tested 
in detail. It has been possible to find analytically the spectral density of the instantaneous 
Hessians and hence provide an analytical expression for the K-S entropy within the diagonal 
approximation. For strongly chaotic systems, the diagonal approximation is an excellent 
estimate of the K-S entropy itself. There is no real difference between the numerical diag- 
onal and the analytical diagonal approximations. For weakly chaotic systems, the diagonal 
approximation is not good, but this is natural. It is more accurate than the upper bound 
in all dynamical regimes. It has strange double-well-like oscillations that is not an artifact 
of the extra approximations going into getting an analytic expression, as it is there in the 
numerical diagonal results as well. It is also interesting that the K-S entropy is not an even 
function of K. It turns out that the details of the analytical expression cannot be neglected 
for moderate values of N, and K. For increasing particle number, the absolute error in the 
diagonal approximation is negligible except where it slowly grows in the weak chaos regime. 
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Nevertheless, even there the per particle entropy would improve for most values of K. 

The analytical results pertaining to the diagonal approximation were facilitated by de- 
riving the density of states for the instantaneous Hessians, which had a peculiar structure of 
a Gaussian sea along with two large outliers apart from the center of mass mode. The den- 
sity of states histograms for the full and banded approximations are difficult to distinguish 
whereas the diagonal case is a bit further away. All of them match the analytic prediction 
for the level density extremely well. It is interesting that given the long existence of the 
Chirikov estimate for the Lyapunov exponent or the K-S entropy of the two-dimensional 
standard map, this paper has finally provided a generalization to a nontrivial many-body 
extension of the same. In addition, it is curious that an analytic diagonal approximation 
appears to be more difficult for the NN model even though it has a K ■<-)■ — K symmetry 
and thus its instantaneous Hessian possesses a symmetric density of states, and no outliers 
in its spectrum. 

The techniques developed herein have several natural generalizations, for instance to sys- 
tems with dissipation as well as to continuous time Hamiltonian flows. Even as it stands, 
this scheme will provide a pathway into the maze that is high dimensional chaotic phase 
spaces by allowing one to access relatively easily the finite-time K-S entropy and its fluctu- 
ations. The analytical structure behind the finite-time K-S entropy is also intriguing and 
needs to be more fully investigated. 
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